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1. NONEQUILIBRIUM SMALL SYSTEMS 

In 1944 Erwin Schrodinger published the classic monography What is life? where he 
pointed out the importance of physical and chemistry laws to understand living systems 
[1]. The notion that genetic information should be encoded in an "aperiodic crystal" 
seeded the subsequent discovery of the double helix structure of DNA. Chapter 7 of 
Schrodinger's monography contains an interesting discussion about the similarities and 
differences between a clockwork motion and the functioning of an organism. According 
to Schrodinger the regular motion of a clock must be secured by a weak spring. Yet, 
whatever the weakness of the spring is, it will produce frictional effects that do compen- 
sate for the external driving of the clock (e.g. the battery) in order to secure its regular 
motion. Being friction a statistical phenomenon he concludes that the regular motion 
of the clock cannot be understood without statistical mechanics. Then he further states: 
For it must not believed that the driving mechanism really does away with the statistical 
nature of the process. The true physical picture includes the possibility that even a regu- 
larly going clock should all at once invert its motion and, working backward, rewind its 
own spring -at the expense of the heat of the environment. The event is just 'still a little 
less likely' than a 'Brownianfit' of a clock without driving mechanism. 

Recent advances in microfabrication techniques, detection systems and instrumen- 
tation have made possible the measurement of such "inverted motions" referred by 
Schrodinger. The controlled manipulation and detection of very small objects makes 
possible to exert and measure tiny forces appUed on them and follow their trajectories in 
space-time with resolution of piconewtons, nanometers and microseconds respectively. 
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According to the equipartition law, systems with a low number of degrees of freedom 
embedded in a thermal environment exhibit energy fluctuations that are a few times 
(^B being the Boltzmann constant and T the environmental temperature). Techniques 
such as atomic force microscopy (AFM), optical tweezers (OT) and magnetic tweez- 
ers (MT) allow for the controlled manipulation of individual molecules such as nucleic 
acid structures and proteins [2], the measurement of very small energies (within the 
scale) [23] and the observation of "inverted motion" in translocating enzymes [3]. 
These developments during the past years have been accompanied by a concomitant 
progress of theoretical results in the domain of nonequilibrium physics [4]. This contri- 
bution reviews some of the most basic concepts around fluctuation theorems and their 
experimental verification. 



1.1. Control parameters, configurational variables and the definition 



In small systems it is crucial to make a distinction between controlled parameters and 
non-controlled or fluctuating variables. Controlled parameters are those macroscopic 
variables that are imposed on the system by the external sources (e.g. the thermal en- 
vironment) and do not fluctuate with time. In contrast, non-controlled variables are mi- 
croscopic quantities describing the internal configuration of the system and do fluctuate 
in time because they are subject to Brownian forces. Let us consider a typical single 
molecule experiment where a protein is pulled by an AFM. In this case the control pa- 
rameter is given by the position of the cantilever that determines the degree of stretching 
and the average tension applied to the ends of the protein. Also the temperature and the 
pressure inside the fluidic chamber are controlled parameters. However, the height of 
the tip respect to the substrate or the force acting on the protein are fluctuating variables 
describing the molecular extension of the protein tethered between tip and substrate. 
Also the position of each of the residues along the polypeptide chain are fluctuating 
variables. Both molecular extension or force and the residues positions define different 
types of configurational variables. However only the former are subject to experimental 
measurement and therefore we will restrict our discussion throughout this paper to such 
kind of experimentally accessible configurational variables. Figure 1 illustrates other 
examples of control parameters and configurational variables. In what follows we will 
denote by A the set of controlled (i.e. non-fluctuating) parameters and x the set of config- 
urational (i.e. fluctuating) variables. The definition of what are controlled parameters or 
configurational variables is broad. For example, a force can be a configurational variable 
and a molecular extension can be a controlled parameter, or vice versa, depending on 
the experimental setup (see Figure 1, right example). 

The energy of a system acted by external sources can be generally described by 
a Hamiltonian or energy function, U{x,X). The net variation of U is given by the 
conservation law. 



of work 




(1) 
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FIGURE 1. Control parameter and conflgurational variables. Different experimental setups corre- 
sponding to different types of control parameters (denoted as A) or conflgurational variables (denoted as 
X). (Top left) A micron-sized bead dragged through water A could be the center of the trap measured in 
the lab (i.e. flxed to the water) frame whereas x is the displacement of the bead, indicated as y, respect to 
the center of the trap. (Bottom left) A polymer tethered between two surfaces. A is the distance between 
the surfaces and x the force acting on the polymer (Right) A polymer stretched with magnetic tweezers. A 
is the force acting on the magnetic bead and x is the molecular extension of the tether. Figure taken from 
[3]. 



where dQ, dW stand for the infinitesimal heat and work transferred to the system. The 
previous mathematical relation has simple physical interpretation. Heat accounts for the 
energy transferred to the system when the configurational variables change at fixed value 
of the control parameter. Work is the energy delivered to the system by the external 
sources upon changing the control parameter for a given configuration. The total work 
performed by the sources on the system when the control parameter is varied from A,- to 
Ay is given by, 




where F{x,X) is a generalized force defined as, 




It is important to stress that the generalized force is not necessarily equal to the me- 
chanical force acting on the system. In other words, F{x,X) is a. configurational depen- 
dent variable conjugated to the control parameter A and has dimensions of [energy]/[A] 
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which are not necessarily Newtons. In the example shown in the right of Figure 1 the 
control parameter is the magnetic force A = / and the configurational variable x is the 
molecular extension of the polymer. The total Hamiltonian of the system is then given 
by U (x, /) — Uo{x) — fx where Uo{x) is the energy of the system at A = / = 0. In other 
words, the external force / shifts all energy levels (defined by x) of the original system 
by the amount - fx. The generalized force is then given by F{x,f) = —x (i.e. it has the 
dimensions of a length) and dW = —xdf. The fact that dW is equal to —xdf and not 
equal to fdx has generated some controversy [5]. Below we show how this distinction 
is already important for the simplest case of a bead in the optical trap. In Section 2.1 
we also show how the physically sound definition of mechanical work is amenable to 
experimental test. 



1.2. A classical experiment: the bead in the optical trap 

In 2002 Dennis Evans and coworkers in Camberra (Australia) performed the first 
experiment where the "inverted motions" could be observed [6]. The experiment is 
shown in Figure 2a. A micron-sized spherical bead made of silica or polystyrene is 
immersed in water inside a fluidic chamber and captured in an optical trap of infrared 
light generated by a high numerical aperture objective. Initially the trap is at a rest 
position and the bead is in thermal equilibrium and fluctuating around the center trap 
position. Suddenly the trap is set into motion at a constant speed v and the bead is 
dragged through the water. After a transient time x — j/k the bead reaches a steady state 
where the Stokes frictional force is counter balanced by the optical trapping force. The 
average bead position lags behind the center of the trap by a distance y = yv/k where 
7 = 67tr\R is the friction coefficient {r\ is the water viscosity and R is the bead radius) 
and k is the stiffness of the trap. In the laboratory frame (see Figure 2a) the bead and trap 
center have coordinates x{t) and x*{t) = vt (we take x = x* = att = when the trap 
is set in motion). The distance between the center of the trap and the bead isy = x*—x 
and the restoring force acting on the bead is given by F{y) = ky. In this example the 
control parameter is given by the trap center X — x* whereas x is the configurational 
variable. The trapping energy of the bead is given by f/(x, A) = ( l/2)k{x — A)^ and the 
generalized force F — k{X —x)=ky (cf. Eq.(3)). The work exerted by the trap on the 
bead is then equal ioW = jQF{y)dx* = vk jQy{s)ds. The first remarkable fact in this 
expression is that the work W is neither equal to W' = jQF(y)dx nor W" = jQF{y)dy. 
These three quantities have different physical meaning. In fact, by exactly integrating 
the force, W" becomes equal to the energy difference between the initial and final 
configurations. Whereas W' is equal to minus the heat, —Q. Since dy = dx* — dx what 
we are now facing is again the mathematical statement of energy conservation. Note 
also that the work definition is non-invariant under Galilean transformations. In fact, the 
work definition requires thatx, as measured in the lab frame, is the proper configurational 
variable. If we choose y rather than jc (y is now measured in the trap-moving frame) then 
U{y,X) = {l/2)ky^ is independent of A and the work would be identically zero which 
makes no sense. 
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FIGURE 2. The bead in the optical trap dragged through water, (a) Variables defining the experi- 
ment, (b) Work distribution measurements corresponding to different elapsed times. The mean work W 
and variance increase with time (Inset). The main panel shows the experimental test of the fluctuation 
relation Eq.(7) for all experimental data put together. 



By repeating the moving trap experiment an infinite number of times a work distri- 
bution will be produced. The shape of the work distribution must be Gaussian because 
the stochastic variable y follows an Omstein-Uhlenbeck process that can be described 
by a linear Langevin equation. Consequently, only the first and second cumulants of the 
work distribution are non-zero. Let us note in passing that the Gaussian property is not 
fulfilled by the heat and the energy difference, which are known to exhibit exponential 
tails [8, 9]. The mean work W and variance = W'^ — can be easily worked out 
in the asymptotic regime for times t that are longer than the relaxation time of the bead, 
t » y/k. In this limit, 

W = vk f y{s)ds vkyt = Jv^t (4) 
h 

o^^W^-W^^ [ [ y{si)y{s2)dsids2 ^ 2v^k^t [ y{0)y{s)ds = 

JO Jo Jo 

= Iv^khy^T = Iv'kh^^l = Ik^Tyvh (5) 

k k 

where — stands for an average over trajectories. In deriving Eq.(5) we used time- 

translational invariance in the steady state and the result yi^^yis) = j(0)^exp(— ^/r) 

in the steady state (t = yjk being the bead relaxation time) with j(0)^ = k^T jk due to 
the equipartition law. The work probability distribution is finally given by. 

These relations teach us various things: 

1 . Second law. The mean work W is always positive (second law) and only vanishes 
at all times for v — > 0, i.e. when the trap is moved in a quasistatic way. 
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2. Observation of "Inverted motions". Although W >0 there are always trajectories 
for which W <0. These are the "inverted motions" refereed to by Schrodinger and 
recently renamed as "transient violations of the second law". Along these "inverted 
motion" trajectories the bead extracts energy from heat fluctuations to overcome 
the frictional forces and to move ahead of the center of the trap. 

3. "Inverted motions" as rare events. Both the mean work and the standard devia- 
tion of the work increase with time and trap speed. However the standard deviation 
Gw increases as ^/i whereas W increases faster (linearly with t). Therefore, al- 
though it is possible to find trajectories where W <0, these are rare events because 
their relative fraction decreases exponentially fast with time. W <0 trajectories be- 
come more probable (i.e. less rare) at short times. In the limit ? — )■ they reach the 
50% of all events. 

4. Fluctuation relation. The work probability density function shown in Eq.(6) sat- 
isfies a fluctuation relation. From Eqs.(4,5) we find <7^ = Ik^TW. It is straightfor- 
ward to check that the following relation holds, 

P{W) f W \ 

- exp — . (7) 



P{-W) \k^T 

Eq.(7) receives the name of a fluctuation relation because it is an exact mathe- 
matical relation describing arbitrarily large work fluctuations. Eq.(7) was derived 
from Eq.(6) which was obtained in the limit of long enough times. More elaborate 
calculations show that this relation is exact for arbitrary times [7, 8]. 

In Figure 2b we show an experimental test of these results. The fluctuation relation 
in Eq.(7) corresponds to a special case of what is known as transient fluctuation the- 
orem (TFT) [10]. The system is initially in equilibrium and transiently driven out of 
equilibrium by external forces. The generalization of such relation to include arbitrary 
nonequilibrium transient states gives the fluctuation relation by Crooks described in the 
next section. 



2. THE CROOKS FLUCTUATION RELATION AND FREE 

ENERGY RECOVERY. 

Let us consider a generic system in thermal equilibrium that is transiently driven out 
of equilibrium during the time interval [0,?/] by varying X according to a protocol X{t) 
from an initial value X (0) = Xi to a final value X (tf) = Xf. We refer to this as the forward 
(F) process. By repeating this process an infinite number of times we generate the work 
distribution Pp{W). Let us consider now the reverse process where the system starts in 
equilibrium at Xf and X is varied according to the time reversal protocol, X {tf — t), until 
reaching the final value Xi (see Figure 3). The reverse (R) process can be repeated an 
infinite number of times to produce the work distribution Pr{W). The Crooks fluctuation 
relation (CFR) reads [11], 

Ppiw) fw-^G\ 

exp (8) 
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(a) Forward process : A(0 (b) Reverse process : A(^^ - 1) 




FIGURE 3. Forward and reverse paths, (a) An arbitrary forward protocol. The system starts in 
equilibrium at A; and is transiently driven out of equilibrium until Xf. At Xf the system may be or not 
in equilibrium, (b) The reverse protocol of (a). The system starts in equilibrium at A/ and is transiently 
driven out of equilibrium until A,-. At A,- the system may be or not in equilibrium. 



where AG = G{Xf) — G(A,) is equal to the free energy difference between the equilib- 
rium states at Xf and A/. Eq.(7) is a particular case of the CFR where PfiW) = Pr{W) 
(the trapping potential is symmetric V{y) = V{—y)) and AG = (the free energy of the 
bead in the trap does not depend on the position of the trap, x*). A particular result of 
the CFR is the well-known Jarzynski equality [12], exp{—W /k^T) = exp{—AG/k^T), 
that has been used for free energy recovery [13, 14] by inverting the mathematical iden- 
tity, AG = —kBT\og{exp{—W/kBT)). However this expression is strongly biased for a 
finite number of measurements [15, 16]. Bidirectional methods that combine informa- 
tion from the forward and reverse processes and use the CFR have proven more predic- 
tive [17, 18, 19]. In particular the CFR immediately implies that Pf{W) = Pr{-W) for 
W = AG showing that it is possible to measure AG in irreversible processes by measuring 
the forward and reverse irreversible work distributions and looking for the value of W 
where they cross each other. The CFR was experimentally tested in 2005 in RNA pulling 
experiments with laser tweezers [20] showing this to be a reliable and useful method- 
ology to extract free energy differences between states that could not be measured with 
bulk methods. 

In Figure 4 we summarize recent results obtained in the Small Biosystems lab in 
Barcelona for the mechanical unfolding/refolding of DNA hairpins [21, 22] using a dual- 
beam miniaturized optical tweezers [23]. DNA hairpins are versatile structures formed 
by a stem of a few tens of base pairs that end in loop. They have some advantages as 
compared to RNA structures such as the easier synthesis and larger chemical stability. 
DNA hairpins can be easily synthesized and ligated to dsDNA handles to produce a 
construct ready to be pulled with the tweezers [24]. By chemically labeling the ends 
of the dsDNA handles it is possible to tether a DNA construct (formed by the DNA 
hairpin inserted between the two flanking handles) between two micron sized beads. 
One bead is immobilized in the tip of a pipette. The other bead is captured in the optical 
trap. The deflected light by the trapped bead provides a direct measurement of the force 
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FIGURE 4. Mechanical folding/unfolding of DNA hairpins.(a) The sequence of a DNA hairpin with a 
21bp stem ending in a tetraloop. (b) Experimental setup. A molecular construct made of the hairpin shown 
in (a) flanked by two dsDNA handles (29bp each) is tethered between two micron-sized beads. In the 
experiments the trap is moved relative to the pipette at speeds ranging from 10 to lOOOnm/s. (c) Different 
force cycles recorded at 300nm/s. The red curves indicate the stretching parts of the cycle whereas the 
orange curves indicate the releasing parts of the cycle. Note that the forces of unfolding and refolding 
are random due to the stochastic nature of the thermally activated unfolding/folding process. The marked 
hysteresis is a signature of an irreversible process, (d) Measurement of work for a single trajectory. It is 
given by the area below the force-distance curve integrated between two trap positions. Trap distances 
are relative. Note that there might be more than one unfolding or refolding event along each trajectory. 
f* {S){f* {R)) defines the first rupture force in the unfolding (refolding) process. Figure taken from [21]. 



applied on the molecule. By repeatedly steering the optical trap back and forth it is 
possible to unfold and refold the hairpin structure many times until the tether breaks. 
The unfolding of the hairpin is revealed by a sudden drop in the force due to the increase 
in molecular extension from the released single- stranded DNA of the hairpin. Such 
increase causes a retraction in the position of the bead in the trap and a force drop. 
Analogously, when the hairpin refolds a sudden increase in force is observed. One of the 
most successful constructs we have designed in our lab consists of DNA hairpins linked 
to two beads via extremely short (29bp) dsDNA handles [25] . These constructs are found 
to moderately increase the signal-to-noise ratio of the measurements allowing for precise 
work measurements. In a pulling experiment the force versus the relative trap-pipette 
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FIGURE 5. The Crooks fluctuation relation.(a) Work distributions for the hairpin shown in Figure 4 
measured at three different loading rates: 50 nm/s (blue), 100 nm/s (green) and 300 nm/s (red). Unfolding 
or forward (continuous lines) and refolding or reverse work distributions (dashed lines) cross each other 
at a a value ~ ^Ik^T independent of the loading rate.(b) Experimental test of the CFR for 10 different 
molecules pulled at different speeds. The log of the ratio between the unfolding and refolding work 
distributions is equal to {W — AG) in k^T units. The inset shows the distribution of slopes for the different 
molecules which are clustered around an average value of 0.96. Figure taken from [21]. 

distance is recorded and the area below that curve provides a direct measurement of the 
work. Repeated measurements of the work make possible an experimental verification 
of the CFR (see figure 5). 

2.1. About the right definition of work: accumulated versus 

transferred work 

In a pulling experiment there are two possible representations of the pulling curves 
(Figure 6b). In one representation the force is plotted versus the relative trap-pipette 
distance (A), the so-called force-distance curve (hereafter referred as FDC). In the other 
representation the force is plotted versus the relative molecular extension (x), the so- 
called force-extension curve (hereafter referred as FEC). In the optical tweezers setup 
X = x + y where y is the distance between the bead and the center of the trap. The 
measured force is given hy F = ky where k is the stiffness of the trap. The areas below the 

FDC and the FEC define two possible work quantities, W = j^^ FdX and W' = j^l Fdx. 
From the relation dX = dx + dy we get, 

W = W' + Wb = W'+ ' (9) 

2k 

where Fi, Ff are the initial and final forces along a given trajectory. W is often called 
the total accumulated work and contains the work exerted to displace the bead in the 
trap, Wb, and the work transferred to the molecular system, W' (therefore receiving the 
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FIGURE 6. FDC versus FEC. (a) Experimental setup and different variables, (b) The FDC and FEC 
are defined as the curves obtained by plotting the force versus the trap position or the molecular extension 
respectively. Although force fluctuations in both types of curves show a dependence with the bandwidth 
of the measurement (black, IkHz; green 20 kHz) only in the FEC the measiu^ement of the work is very 
sensitive to such fluctuations. Figure taken from [27]. 



name of transferred work) [26, 27]. The term Wt, appearing in Eq.(9) implies that W, W' 
cannot simultaneously satisfy the CFR. What is the right definition of the mechanical 
work? In other words, which work definition satisfies the CFR? The problem we are 
facing now is identical to the one we previously encountered in section 1 .2 where we had 
to distinguish between work and heat. The answer to our question is straightforward if 
we correctly identify which are the control parameters and which are the configurational 
variables. In the lab frame defined by the pipette (or by the fluidic chamber to which the 
pipette is glued) the control parameter A is given by the relative trap-pipette distance, 
whereas the molecular extension x stands for the configurational variable. Note that, due 
to the non-invariance property of the CFR under Galilean transformations, y cannot be 
used as configurational variable because it is defined respect to the co-moving frame 
defined by the trap. The same problem was found in section 1.2 when comparing the 
distances x and y for the bead in the trap. The total energy of the molecular system is then 
given by [/(x, A) = Um{x) + {k/2){X —xY where Um{x) is the energy of the molecular 
system. From Eq.(3) and using A = x -|- j we get F = ky = k{X — x) . From Eq.(2) we 
then conclude that the mechanical work that satisfies the CFR is the accumulated work 



Recent progress in fluctuation theorems and free energy recovery 



January 18, 2011 



10 



W rather than the transferred work W'. We remark a few relevant facts, 

1. The transferred work W' does not satisfy the CFR and is dependent on the 
bandwidth of the measurement. The FDC and FEC are sensitive to the bandwidth 
or data acquisition rate of the measurement (Figure 6b). Whereas W is insensitive to 
the bandwidth W' is not (see Figure 7a). This difference is very important because 
it implies that the bandwidth dependence implicit in the boundary term in Eq.(9) 
(the power spectrum of the force depends on the bandwidth if this is smaller than 
the comer frequency of the bead) is fully contained in W'. Operationally it is 
much easier to use W rather than W'. As shown in Figure 7b, W satisfies the CFR 
whereas W' does not. The logarithm of the ratio log{PF{W') / Pr{—W')) plotted 
versus W' /k^T is strongly bandwidth dependent and exhibits a slope 30 times 
smaller than 1 (i.e. the slope expected for W from the CFR) [27]. 

2. How big is the error committed in recovering free energy differences by using 
W' rather than Wl Despite that W and W' only differ by a boundary term (cf. 
Eq.9) one can show that, for the case of the mechanical folding/unfolding of 
the hairpin, the error in recovering free energy differences using the Jarzynski 
equality can be as large as 100% [27]. The error or discrepancy increases with the 
bandwidth. Interestingly enough, for small enough bandwidths (but always larger 
than the coexistence kinetic rates between the folded and unfolded states, otherwise 
the folding/unfolding transitions are smeared out) fluctuations in the boundary 
term in Eq.(9) are negligible and both W and W' are equally good. This explains 
why previous experimental tests of the CFR that used W' instead of W produced 
satisfactory results (e.g. [20]). 

3. Inequivalence between moving the trap and the pipette or chamber. The non- 
invariance of the CFR under Galilean transformations suggests that moving the 
optical trap inside the fluidic chamber should not be necessarily equivalent to 
moving the pipette glued to the fluidic chamber. We have to distinguish two cases 
depending on whether the fluid inside the chamber is dragged (stick conditions) 
or not (slip conditions) by the moving chamber. The two scenarios are physically 
different because in the former case the bead in the trap is subject to an additional 
Stoke force due to the motion of the fluid. If the fluid is not dragged by the moving 
chamber (slip conditions) then y is the right configurational variable. In this case, 
U{y,?i) — Um{?i—y) + {k/2){y)^ and the generalized force is equal io F — U'^{X — 
y). Note that this F is not equal to the instantaneous force measured by the optical 
trap but the instantaneous force acting on the molecule. Even in case of mechanical 
equilibrium the difference between the two instantaneous forces, U'^{X —y) and 
ky, produces a net non-negligible difference term. If the fluid does move with the 
chamber (stick conditions) then x is again the right configurational variable and we 
recover the main results of this section. Interestingly, all experiments done until 
now that use motorized stages to move chambers operate in stick conditions so we 
do not expect experimental discrepancies for the definition of the work. 

4. Other cases where the work definition matters. As we showed in Figure 7 the 
CFR and the right definition of work W are both amenable to experimental test. 
Another interesting example where the boundary term is relevant is when the force 
/ (rather than the trap position) is controlled. As we saw in Section 1.1 the work 
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in that case is given by Wxq = — Jj:^ Xdf where X =y + x + XQ is the absolute 
trap-pipette distance. Because Xq stands for an arbitrary origin, the work Wxq is 
also a quantity that depends on Xq. This may seem unphysical but it is not [5]. The 
CFR is invariant respect to the value of Xq as it can be easily checked by writing, 
Wxo = Wxa=o - Xoiff - fi), and using Eq.(8) gives AGxq = AGxo=o - /Xq. If the 
force / is controlled, then other work related quantities such as W' = j^! fdx or 

Xf 

W" = j^. fdX differ from W by finite boundary terms. Again these terms make 
the CFR not to be satisfied for W' and W" . These predictions are amenable to 
experimental test in magnetic tweezers (where the force is naturally controlled) or 
in optical tweezers operating in the force clamp mode with infinite bandwidth [28] 
(and possibly in a force feedback mode with finite bandwidth as well). 
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3. A GENERALIZED FLUCTUATION RELATION 



The CFR can be generalized to cases where the system is initially in partial, rather than 
global, equilibrium both in the forward and the reverse protocol [29]. Suppose we take 
a system at fixed control parameter A in thermal equilibrium with a bath at temperature 
T . The probability distribution over configurational variables x is Gibbsian over the 
whole phase space S meaning that: P^)^{x) = exp{—Ex (x) /k'QT)/Zi with the partition 
function Zx = 'Lxes^wi~Ex {x)/k^T), where Ex (x) is the energy function of the system 
for a given pair We refer to this condition as global thermodynamic equilibrium. 
However we might consider a case where the initial state is Gibbsian but restricted 
over a subset of configurations S' C S. We refer to this case as partial thermodynamic 
equiUbrium. Partially equilibrated states satisfy P^gi{x) = P^{x)Xs'ix)Zx/Zx^s'-> where 
Xs' is the characteristic function defined over the subset 5' C 5 iXs' = I if x e S' and 
zero otherwise], and Zx_s' is the partition function restricted to the subset S', i.e. Zxs' = 
Taxes' ^Wi~Ex{x) /kBT) . The partial free energy is then given by Gx^s' — ~kBT\ogZx^s'- 
Let us suppose again the scenario depicted in Figure 3. Along the forward process the 
system is initially in partial equilibrium in Sq at Aq. Along the reverse process the system 
is initially in partial equiUbrium in at Xi . The generalized CFR reads. 



W-AG^'j' 
kBT 



(10) 



where the direction of the arrow distinguishes forward from reverse, p^°^^^ 
stands for the probability to be in Si (Sq) at the end of the forward (reverse) process, 
and AG^J'j; = Gs,{Xi) - Gs^ih) is the free energy difference between the partially 
equilibrated states Sq and S\. 

Partially equilibrated states appear in many cases, from thermodynamic branches to 
intermediate and misfolded molecular states . The usefulness of the generalized CFR 
relies on our possibility to experimentally distinguish the substates visited along any 
trajectory and that these substates be visited frequently enough. For example, a molecule 
pulled by stretching forces can be in partial equilibrium when it stays either in the folded 
or unfolded state until it transits to the other state. If Sq stands for the folded state and S\ 
for the unfolded state, the generalized CFR makes possible to extract the free energies 
Gy (A) of the folded and unfolded states S' — Sq, S\ along the A-axis, i.e. the folded and 
unfolded branches. Figure 8 shows an experimental verification of this result for a DNA 
haiprin that folds/unfolds in a two-states manner. 



4. CONCLUSION 

The possibility to experimentally measure the inverted motions remarked by 
Schrodinger more than half a century ago has boosted the study of energy fluctua- 
tions in very small objects under nonequilibrium conditions. The possibility to measure 
work fluctuations in single molecules that are mechanically unfolded has provided the 
testing ground for some of the most recent theoretical developments in nonequiUbrium 
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FIGURE 8. The generalized Crooks fluctuation relation, (a) Constrained work distributions mea- 
sured in a 20bp hairpin at two different pulling speeds: 300nm/s (red, unfolding; green, refolding) and 
40nm/s (blue, unfolding; orange, refolding). (a,Inset) The forward trajectories we consider are those 
where the hairpin starts partially equilibrated in the folded (F) state at Ao and ends in the unfolded (U) 
state (partially equilibrated or not) at Ai.Note that, due to the correction term p^^^ /p^^ appearing 
in Eq.(lO), restricted unfolding and refolding work distributions should not cross each other at a work 
value that is independent of the pulling speed, (b) Reconstruction of the folded (cyan color) and unfolded 
(green) free energy branches by applying the generalized CFR, Eq.(lO), as shown in (a) and by varying the 
parameter x = X\. The two branches cross each other around Xc — Wlnm corresponding to the coexistence 
transition. For x < (x > x^) the F (U) state is the minimum free energy state. The upper left inset shows 
an enlarged view of the crossing region. The lower left inset shows the importance of the correction term 
Py!^^ Ip^^ appearing in Eq.(lO). If that term was not included in Eq.(lO) the coexistence transition 
disappears. Figure taken from [29]. 



Statistical physics. Fluctuation relations and fluctuation theorems (e.g. the Gallavotti- 
Cohen theorem for steady state systems [30]) are examples of new results that quantify 
inverted motions in nonequilibrium states. Measuring inverted motions has also practical 
applications: the Crooks fluctuation relation (CFR), Eq.(8), and its generalization to 
partial (rather than full) equilibrium conditions, Eq.(lO), allows us to extract free energy 
differences between native or non-native states and free energies of thermodynamic 
branches. Future studies will also show the reliability of these methodologies to extract 
free energies of misfolded and intermediate states in RNAs or proteins, and base-pair 
free energies in nucleic acids unzipped under irreversible conditions. We also stressed 
how important is the correct definition of mechanical work to ensure the validity of 
the CFR. In this regard serious inconsistencies are encountered using other definitions 
of mechanical work but such inconsistencies are nowadays amenable to experimental 
test. Related to this, it is also important to underline the general non-invariance of 
fluctuation relations and theorems under Galilean transformations [31], an aspect that 
has not been stressed enough and that can also be tested in experiments. Finally, all the 
studies covered in this note address energy fluctuations of small classical systems under 
Gaussian noise conditions. It would be highly desiderable to have experiments done in 
systems in the regime of non-Gaussian noise (maybe at submicroseconds timescales), 
or in quantum systems where the concept of classical trajectory looses its usual meaning 
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[32]. 
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